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UNIFORM FRACTIONAL FACTORIAL DESIGNS 

By Yu Tang^, Hongquan Xu^ and Dennis K. J. Lin 

Soochow University, University of California, Los Angeles and 
Pennsylvania State University 

The minimum aberration criterion has been frequently used in 
the selection of fractional factorial designs with nominal factors. For 
designs with quantitative factors, however, level permutation of fac- 
tors could alter their geometrical structures and statistical properties. 
In this paper uniformity is used to further distinguish fractional fac- 
torial designs, besides the minimum aberration criterion. We show 
that minimum aberration designs have low discrepancies on average. 
An efficient method for constructing uniform minimum aberration 
designs is proposed and optimal designs with 27 and 81 runs are ob- 
tained for practical use. These designs have good uniformity and are 
effective for studying quantitative factors. 

1. Introduction. The minimum aberration criterion [Fries and Hunter 
(1980)] has been frequently used in the selection of regular fractional factorial 
(FF) designs with nominal factors, as it provides nice design properties. This 
is especially important when the experimenter has little knowledge about 
the potential significance of factorial effects. The readers are referred to 
Mukerjee and Wu (2006) and Wu and Hamada (2009) for existing theory and 
results on minimum aberration designs. Deng and Tang (1999), Tang and 
Deng (1999) and Xu and Wu (2001) further proposed generalized minimum 
aberration criteria for comparing nonregular fractional factorial designs. 

Cheng and Wu (2001) and Fang and Ma (2001) found that designs may 
have different geometrical structures and statistical properties, even though 
they share the identical word-length pattern. In view of this, Cheng and Ye 
(2004) pointed out that the distinction in the analysis objective and strat- 
egy for experiments with nominal or quantitative factors requires different 
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Table 1 

Two combinatorially isomorphic designs with different geometrical structures 
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selection criteria and classification methods. For designs with quantitative 
factors, they proposed to describe design properties using the geometrical 
structures. Two designs are said to be geometrically isomorphic if one can 
be obtained from the other by a permutation of factors and/or reversing the 
level order of one or more factors. For example, consider the two designs in 
Table 1. Design A is a reg ular 3^-^ FF design with F^ = Fi+ F2 (mod 3), 
and Design B is formed by F^ = Fi + F2 + 2 (mod 3) . It is obvious that 
these two designs are combinatorially isomorphic to each other, because one 
can be obtained from the other by permuting the levels in the third column 
[i.e., map (0, 1, 2) to (2, 0, 1)]. However, they have different geometrical 
structures and thus are geometrically nonisomorphic. Design B contains the 
center run with all ones, while Design A does not. If we reverse the level 
order [i.e., map (0, 1, 2) to (2, 1, 0)] for all three columns. Design B is 
invariant while Design A is not. These two designs have different statistical 
properties due to their different geometrical structures. 

To further classify geometrically nonisomorphic designs, Cheng and Ye 
(2004) generalized the concept of minimum aberration and used indicator 
function to define the /3-word-length pattern based on a polynomial model. 
Despite its theoretical beauty, the complexity of indicator function prohibits 
its use for design construction. On the other hand. Fang and Ma (2001) 
suggested using uniformity to compare the performance of geometrically 
nonisomorphic designs. Various discrepancies have been used as measures 
of uniformity; see Fang et al. (2000) and Fang, Li and Sudjianto (2006). 
These discrepancies all have their geometrical meanings and can be inter- 
preted as the difference between the empirical distribution and the uniform 
distribution. Among them, the centered L2-discrepancy (CD), proposed by 
Hickernell (1998), is the most frequently used. 



UNIFORM FRACTIONAL FACTORIAL DESICNS 



3 



Both the /3-word-length pattern and the centered L2-discrepancy reflect 
the geometrical structure of the design. Here we use the discrepancy to 
choose FF designs mainly for two reasons. First, the centered L2-discrepancy 
has a simple analytic formula; it is much faster to calculate the discrep- 
ancy than the /3-word-length pattern. The difference between the compu- 
tational times is substantial. The second and more important reason is 
that the /3-word-length pattern is model-dependent while the centered L2- 
discrepancy is model free. Cheng and Ye (2004) defined the /3-word-length 
pattern based on a polynomial model but they further pointed out that the 
/3-word-length pattern needs to be modified in other situations. Optimal 
designs constructed based on the /3-word-length pattern would rely on the 
specific model used. In contrast, designs with low discrepancy tend to have 
good space filling properties and are model robust in the sense that they 
can guard against inaccurate estimates caused by model misspecification 
[Hickerneh and Liu (2002)]. 

Here we propose to construct uniform FF designs from existing minimum 
aberration designs via level permutations. Obviously, for two-level designs, 
there is no difference when levels are permuted, but for high-level designs, 
there are many unknowns to be studied. For convenience, we will focus on 
three-level designs in this paper, but the basic ideas can be extended to 
higher-level designs. 

The paper is organized as follows. In Section 2, we obtain a key theorem 
and show that minimum aberration designs tend to have low discrepancy 
on average. Then we introduce the concept of uniform minimum aberration 
design. In Section 3, we present an efficient way for constructing three-level 
regular uniform FF designs and construct uniform minimum aberration de- 
signs with 27 runs and 81 runs for practical use. These newly-constructed 
designs often outperform existing uniform designs, especially when the num- 
ber of factors is large. In Section 4, we examine the relationship between the 
discrepancy and the /3-word-length pattern. Uniform minimum aberration 
designs appear to perform well with respect to the /3-word-length pattern. 
The last section gives a brief conclusion. For clarity, we defer all proofs to 
the Appendix. 

2. Uniform minimum aberration designs. A design with N runs, n fac- 
tors and s levels, denoted by {NjS"^), is an iV x n matrix. Throughout the 
paper, the s levels are denoted as 0, — 1. For an (A/', s")-design D, 

consider an ANOVA model 

Y = Xoao + Xiai H h X„a„, + e, 

where Y is the vector of N observations, oq is the intercept and Xq is an 
iV X 1 vector of I's, Oj is the vector of all j-factor interactions and Xj is 
the matrix of orthonormal contrast coefficients for aj, and e is the random 

error. Denote rij = (s — !)■''(") and Xj = {x^j})Nxnj, then the (generalized) 
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word-length pattern of design D can be defined by 

2 



(2.1) 



Aj{D) = N' 



k=l 
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i=l 



ik 



for j = 0, . . 



,n. 



For two designs D^^^ and D^"^^ , D^^^ is said to have less aberration than D^"^^ 
if there exists an r G {l,2,...,n}, such that Ar{D^^^) < Ar{D'''^^) and 
Ai{D^'^^) = Ai{D^'^^) for i = 1, . . . ,r - 1. D^^^ is said to have (generalized) 
minimum aberration if there is no other design with less aberration than D^^' . 

For a regular design, the traditional definition of Aj{D) is the number 
of words of length j. Following Xu and Wu (2001), Aj{D) defined in (2.1) 
is the number of degrees of freedom associated with all words of length j. 
Therefore, two definitions are equivalent and generalized minimum aberra- 
tion reduces to minimum aberration for regular designs. For simplicity, in the 
following we use the notion of word-length pattern and minimum aberration 
for both regular and nonregular designs. 

For an (A^, s")-design D = {xik)Nxn, its centered L2-discrepancy (CD) is 
defined as 
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where Uik = {2xik + l)/(2s). Note that < Uik < 1. 

It is well known that word-length pattern remains the same for combina- 
torially isomorphic designs. However, the centered L2-discrepancy will not 
be the same when levels of factors are permuted. 

Example 2.1. Consider the two designs given in Table 1. Both de- 
signs have one word of length three and share the same word-length pattern 
(^1,^2,^13) = (0,0,2). Their CD values are 0.033186 and 0.033034, respec- 
tively. So Design B is better than Design A in terms of CD. 

There is a close relationship between minimum aberration and uniformity 
for two-level designs. Fang and Mukerjee (2000) showed that for a two-level 
regular design D, the centered L2-discrepancy of D can be linearly expressed 
by its word-length pattern (Ai{D), A2{D), . . . , An{D)). Later on. Ma and 
Fang (2001) generalized it to the nonregular case. Obviously, their results 
cannot be generalized to high-level designs. 

For an s-level factor, there are s\ possible level permutations. Given an 
(A^, s")-design D, we apply all s\ level permutations to each column and 
obtain (s!)" combinatorially isomorphic designs. Denote the set of these 
designs as V{D). Some of them may be geometrically nonisomorphic and 
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have different CD values. We compute the CD value for each design and 
define 0(D) as the average CD value of all designs in V{D), that is, 

^ D'eV{D) 

Note that all designs in V{D) share the same word-length pattern. The 
following result shows that the average CD value, (j){D), is closely related to 
the word-length pattern of D. 

Theorem 2.2. For an {N,3^)-design D, 



Kd) = 




Theorem 2.2 implies that the average centered L2-discrepancy and the 
minimum aberration criterion are approximately equivalent, as (2/29)* de- 
creases geometrically when i increases. Thus designs permuted from a mini- 
mum aberration design tend to be more likely to have low discrepancies. As 
will be seen. Theorem 2.2 is very useful in finding uniform FF designs. 

Example 2.3. Consider designs from the commonly used orthogonal 
array OA(18,3'^); see, for example. Table 2(a) of Xu, Cheng and Wu (2004). 
There are 3, 4, 4 and 3 combinatorially nonisomorphic designs when pro- 
jected onto 3, 4, 5 and 6 factors, respectively. We rank these designs based 
upon the minimum aberration criterion, and denote them as 18-3.1, 18-3.2, 
18-3.3 and etc. For each design, we conduct all possible level permutations 
and compute their CD values. Table 2 shows the average, minimum, max- 
imum and standard deviation of the CD values of all permuted designs, as 
well as one representative of the columns, and ^3 and of the word-length 
pattern. Note that = = for all designs here. It can be seen from Ta- 
ble 2 that the rankings of average, minimum and maximum CD values are 
all consistent with the minimum aberration ranking; that is, less aberration 
leads to lower CD values. It is interesting to note that designs 18-4.3 and 
18-4.4 have the same word-length pattern but different standard deviations; 
so do designs 18-6.2 and 18-6.3. This implies that the word-length pattern 
does not uniquely determine the variance of the CD values of permuted 
designs. 

We further compare the minimum aberration designs with the uniform de- 
signs listed on the Uniform Design (UD) homepage (http : / / www . math . hkbu . 
edu.hk/Unif ormDesign/). These uniform designs, labeled as UD18-3, UD18- 
4, etc., appear to be orthogonal arrays of strength 2 so that Ai = A2 = 0. The 
minimum aberration design 18-3.1 has the same minimum CD value as the 
uniform design UD18-3; however, the former has less aberration (A3 = 0.5 
vs. A3 = 0.67) than the latter. Design 18-4.1 and UD18-4 have the same 



6 Y. TANG, H. XU AND D. K. J. LIN 



Table 2 
Comparison of IS-run designs 



Design 


Columns 


Ave 4> 


Min 4> 


Max (f) 


Sd 4> 


As 


A4 


18-3.1 


12 3 


0.032526 


0.032500 


0.032538 


0.000018 


0.5 




18-3.2 


12 5 


0.032729 


0.032500 


0.032958 


0.000163 


1 




18-3.3 


13 4 


0.033135 


0.033034 


0.033186 


0.000072 


2 




UD18-3 






0.032500 






0.67 




18-4.1 


2 3 4 5 


0.047407 


0.047357 


0.047446 


0.000023 


2 


1.5 


18-4.2 


12 3 5 


0.047611 


0.047391 


0.047866 


0.000166 


2.5 


1 


18-4.3 


12 3 4 


0.048017 


0.047849 


0.048077 


0.000087 


3.5 





18-4.4 


12 5 6 


0.048017 


0.047849 


0.048306 


0.000139 


3.5 





UD18-4 






0.047357 






2 


1.5 


18-5.1 


2-6 


0.065273 


0.065265 


0.065337 


0.000019 


5 


7.5 


18-5.2 


1-3 5 6 


0.065883 


0.065706 


0.066193 


0.000150 


6.5 


4.5 


18-5.3 


1-5 


0.066086 


0.065722 


0.066423 


0.000197 


7 


3.5 


18-5.4 


1 2 5-7 


0.066492 


0.066197 


0.067107 


0.000211 


8 


1.5 


UD18-5 






0.065248 






6.17 


5.17 


18-6.1 


2-7 


0.086964 


0.086914 


0.087145 


0.000057 


10 


22.5 


18-6.2 


1-6 


0.088184 


0.087769 


0.088591 


0.000215 


13 


13.5 


18-6.3 


1-3 5-7 


0.088184 


0.087769 


0.088974 


0.000240 


13 


13.5 


UD18-6 






0.086896 






12.33 


15.5 


18-7 


1-7 


0.115386 


0.114505 


0.116556 


0.000347 


22 


34.5 


UD18-7 






0.113591 






22 


34.5 



properties, and they are indeed combinatorially isomorphic. Design 18-5.1 
has a sHghtly larger minimum CD value (0.065265 vs. 0.065248) and less 
aberration (^43 = 5 vs. ^3 = 6.17) than UD18-5. The same phenomenon also 
appears for design 18-6.1 and UD18-6. UD18-7 has a smaller CD value than 
design 18-7 although they have the same word-length pattern. The exist- 
ing uniform designs have minimum discrepancy for all cases because the 
run size is small here; nevertheless, the level-permuted minimum aberration 
designs are competitive. In summary, by permuting minimum aberration 
designs from the commonly used OA(18,3^), we can obtain good uniform 
FF designs. 

As suggested by Example 2.3, an efficient way for constructing uniform 
FF designs is to start with a minimum aberration design, permute its levels 
and choose the level permutation with the minimum CD value. These de- 
signs have minimum aberration, and good uniformity, and are suitable for 
investigation of both nominal and quantitative factors. 

Definition 2.4. Let be a minimum aberration design. If G ^{0) 
has the minimum centered L2-discrepancy over V{D), then is said to be 
a uniform minimum aberration design. 
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Table 3 
Comparison of 27 -run designs 



Minimum aberration designs Designs on UD homepage 



n 


Ave 4> 


Min (j) 


Max (/) 


A-2 


A3 




A2 


A3 


4 


0.046549 


0.046547° 


0.046553 








0.046547 








5 


0.063818 


0.063689 


0.063878 





2 


0.063525 





2.67 


6 


0.083786 


0.083475'' 


0.083923 





4 


0.083475 





5.33 


7 


0.108701 


0.108061* 


0.109118 





10 


0.108698 


0.10 


12.17 


8 


0.137749* 


0.136644* 


0.138483* 





16 


0.138657 


0.35 


18.44 


9 


0.172783* 


0.170996* 


0.174090* 





24 


0.175343 


0.69 


30.05 


10 


0.218927* 


0.213994* 


0.221241 





42 


0.219131 


1.36 


40.99 


11 


0.273255 


0.264549* 


0.276195 





60 


0.272383 


2 


56 


12 


0.338698 


0.325027* 


0.343084 





80 


0.336401 


2.32 


75.46 


13 


0.418900 


0.397890* 


0.425576 





104 


0.414783 


3.53 


96.20 



*The same CD value as the best existing design; 
* Smaller CD value than the best existing design. 



Example 2.5. Consider 27-run designs. For n = 4 to 13 columns, we 
evaluate average CD values for the existing regular minimum aberration 
designs [see Xu (2005)] and compare with the CD values of the best designs 
listed on the UD homepage. For n = 8 to 10, the average CD values of the 
minimum aberration designs are even smaller than the CD values of the best 
existing designs; see Table 3 above. 

To find uniform minimum aberration designs, we further conduct all pos- 
sible level permutations for these minimum aberration designs and calcu- 
late the minimum and maximum CD values. Table 3 shows the comparison 
between permuted minimum aberration (PMA) designs and the best de- 
signs listed on UD homepage in terms of discrepancy and aberration. For 
all designs, ^1 = is not listed in the table. For n = 4, the PMA design is 
geometrically isomorphic to the one listed on UD homepage. For n = 5, the 
PMA design has a larger CD value than the one listed on UD homepage, 
but the PMA design has less aberration. For n = 6, the PMA design has 
the same CD value as the one listed on UD homepage and has less aberra- 
tion. For n > 6, PMA designs always outperform the best ones listed on UD 
homepage. Note that those designs listed on UD homepage have resolution 2 
(^2 > 0) whereas our designs have resolution 3 (A2 = 0), when n > 6. This 
shows the advantage of our approach and the disadvantage of the purely al- 
gorithmic approach. Further notice for n = 8 and 9, even the maximum CD 
values of all permuted designs, are less than those of the best existing ones. 

3. Construction of regular three-level uniform minimum aberration de- 
signs. This section is devoted to providing an efficient method for con- 
structing uniform minimum aberration designs. For an (A^, 3")-design D, 
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the total number of designs in V{D) is 6". However, when D is a regular 
FF design, many designs in 'P(-D) are geometrically isomorphic and have 
the same CD values. So it will be much easier to find the uniform FF design 
when a regular minimum aberration design is permuted. 

For a three- level factor, exchange of levels and 2 does not change the 
geometrical structure and such a "mirror image" operation keeps its cen- 
tered L2-discrepancy unchanged according to formula (2.2). Denote vTjgj^jj 
as a permutation of (0, 1, 2), that is, vTigj^jj maps (0, 1, 2) to (io) ^ii ^2)- In view 
of the "mirror image" operation, we only need to consider three permutations 
'^012-, 7ri2o and 7r2oi for a three- level design. Notice that 7roi2 is the identity 
map, 7ri2o maps x to x + 1 (mod 3) and 1:201 maps x to x + 2 (mod 3). So 
each permutation is equivalent to a linear permutation, which transforms x 
to X + 6 (mods), where 6 = 0, 1, or 2. 

A regular 3"-~^ FF design D has n — k independent columns, denoted as 
xi, . . . , Xn-k, and k dependent columns, denoted as yi, . . . , y^. It is specified 
by k linear equations: 

' yi = ciixi + C12X2 H h ci,„_fcx„_fc + bi, 

¥2 = C21X1 + C22X2 H h C2,„_fcX„_fc + 62 , 

. Yk = CfclXl + Cfc2X2 H h Ck^n-k^n-k + bk, 

where Cij and bi are constants in GF(3), the finite field of size 3. Note that 
here and after, all algebra operations are performed in GF(3). The standard 
design corresponds to 61 = • • • = 6^ = and is an (n — fc)-dim linear space over 
GF(3). Now any linear permutation of factor levels only alters the coefficient 
vector (61, . . . , 6fc)-^. Obviously, designs corresponding to the same vector 
(61, . . . , 6fc)"^ are actually the same. Thus among all the 3" linearly permuted 
designs, there are at most 3^ intrinsic differences. Moreover, each design 
corresponding to a specific (61, ... , bk)'^ can be obtained by only conducting 
linear permutations to the k dependent columns (mapping yj to y^ + bj for 
j = 1, . . . ,k), while keeping the n — k independent columns unchanged. So 
we have the following lemma. 

Lemma 3.1. For a regular 3""'^ FF design, when all possible linear level 
permutations are considered, the set of all 3" permuted designs consists of 
gn-fc Qopj^gg of the 3^ designs obtained by permuting the k dependent columns. 

For a design corresponding to vector (61, . . . , 6fc)^, consider the "mirror 
image" permutation for all factors, that is, substituting Xj by (2 — Xj) for 
i = 1, . . . ,n — k and yj by (2 — yj) for j = 1, . . . ,k. The resulting "mirror 
image" design actually corresponds to the coefficient vector (2 — 2 J27=i '^1* ~ 
61, . . . , 2 — 2 Cki — bk)^ ■ Because the "mirror image" permutation does 

not change the geometrical structures, these two designs are geometrically 
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isomorphic and have the same CD value. When two coefficient vectors are 
the same, these two designs are identical. Thus we have the following lemma. 

Lemma 3.2. For a regular FF design, there are at most (3^^ + l)/2 
geometrically nonisomorphic designs when all possible level permutations are 
considered. 

Applying the above results, we conduct level permutations of three-level 
minimum aberration designs with 27 runs and 81 runs given by Xu (2005) to 
find designs with minimum discrepancy. The results are concisely presented 
as follows. For 27-run designs, when n = 4 to 6, the first n columns of xi, 
X2, X3, xi + X2 + X3 + 2, xi + 2x2 + 1 and xi + X2 + 2x3 + 1 form a regular 
uniform minimum aberration design; when n = 7 to 13, the first n columns 

of Xi, X2, X3, Xi + X2 + X3 + 1, Xi + 2X2 + 1, Xi + X2 + 2X3, Xi + X3 + 2, 
X2 + 2X3 + 1, Xi + 2X2 + 2X3 + 2, Xi + X2 + 2, X2 + X3 + 2, Xi + 2X2 + X3 

and xi + 2x3 + 1 form a regular uniform minimum aberration design, where 
xi,X2, X3 are independent columns. Their CD values are listed as "Min ^" 
in Table 3. 

For 81-run designs, according to Xu (2005), when n = 5 to 11, the first n 
columns of xi, X2, X3, X4, xi + X2 + X3 + X4, xi + 2x2 + X3, xi + 2x3 + X4, 
xi + 2x2 + 2x4, X2 + X3 + 2x4, xi + X2 + 2x3 + 2x4 and xi + X2 form the 
minimum aberration design; when n = 12 to 20, the first n columns of xi, X2, 

X3, X4, X1+X2-I-X3+X4, Xi-|-2X2-|-X3, X1-I-2X3-I-X4, Xi-|-2X2-|-2X4, X1-I-X2, 
X2 + 2X3 + X4, Xi-|-2X2-|-2X3, Xi + 2X3 + 2X4, X1-I-X3, X1 + 2X2 + X4, X2+X3, 

xi + X2 + X3 + 2x4, xi + X2 + 2x3, X2 + 2x3 + 2x4, xi + X4 and X2 + X4 form 
the minimum aberration design, where xi,X2,X3 and X4 are independent 
columns. Table 4 summarizes the results when the minimum aberration 
designs are permuted. For example, when n = 7, the best linear permutation 
conducted to three dependent columns is (0, 2, 1), which means that the best 
design with minimum CD value 0.102515 is formed by seven columns xi, 
X2, X3, X4, xi + X2 + X3 + X4, xi + 2x2 + X3 + 2 and xi + 2x3 + X4 + 1. As 
three-level designs with 81 runs are not listed on UD homepage, the best 
designs found in Table 4 are apparently new. 

As stated in Lemma 3.2, for a regular 3""^= FF design, there are at most 
(3^^ -|- l)/2 geometrically nonisomorphic designs when all possible level per- 
mutations are considered. Now consider the simplest case with A; = 1. A 
regular 3"""^ minimum aberration design can be specified by y = 2xi -|- • • • -|- 
2x„_i -|- b, where xi,...,x„,„i are the independent columns, y is the de- 
pendent column and b € GF(3). This is equivalent to xi -|- • • • -|- x„_i + y = 
b (mod 3). When levels of y are permuted, they will generate two geometri- 
cally nonisomorphic designs. To be specific, denote Di as the design corre- 
sponds to b = n + i (mod 3) for i = 0, 1, 2. Then Dq contains a row of ones, 
and Di and D2 are geometrically isomorphic. The next theorem provides 
explicit formulas for the CD values of Dq and D\. 
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Table 4 

Results of 81 -run minimum aberration designs 



n Ave (f) Min cf> Best level permutations 



5 


0.062691 


0.062690 

































6 


0.081294 


0.081290 





1 




























7 

8 


0.102528 
0.126795 


0.102515 
0.126764 






2 
2 


1 
1 



























9 


0.154565 


0.154497 





2 


1 





1 






















10 
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0.186255 
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0.225969 
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0.322305 
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0.385994 


0.382976 
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1 


2 


2 
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2 


2 
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0.457704 


0.453338 
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1 


2 


2 


2 





2 


2 


2 
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0.540883 


0.534813 








1 


1 


2 


2 


2 





2 


2 


2 


2 
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0.640085 


0.631437 
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1 
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2 


2 


2 
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0.755854 


0.743782 
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2 


2 


2 
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0.898270 


0.883749 
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2 
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1.066298 


1.048120 
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1 
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2 





2 


2 


2 


2 





1 


2 1 



Theorem 3.3. Let Dq and Di be the two geometrically nonisomorphic 
regular 3^~^ minimum aberration designs, where Dq represents the design 
with the all-one row. Then the centered L2- discrepancies of Dq and D\ are 



and 



(t>{DQ 



+ 2 



+ 



2(-l)" 
33" 



27/ V27 



+ 



(-1) 



n+l 



33n 



As an immediate implication of Theorem 3.3, when n is odd, (pi^i) > 
(j){DQ), so -Do is the uniform minimum aberration design; when n is even, 
4>{Dq) > (j){Di), so Di is the uniform minimum aberration design. 



4. Connection to the /3-word-length pattern. Under the hierarchical prin- 
ciple, Cheng and Ye (2004) defined the /3-word-length pattern. Specifically, 
for an (N, s"')-design, let 9j be the vector of all j-degree interactions and Zj 
be the matrix of orthogonal polynomial contrast coefficients for 6j. Then 
the response Y can be fitted by a polynomial model Y = ZqOq + Zi^i + • • • + 
ZrOk + £• Denote Zj = {zf?)^^-^^' ^ where n'- is the number of effects with 
degree j. The /3-word-length pattern is defined by 



N 

E 



-ik 



k=l i=l 



foi j = 0,...,K, 
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where K = n[s — 1) represents the highest polynomial degree. Cheng and 
Ye (2004) argued that a good design should minimize /3i,/32, . . . ,13k in a se- 
quential order. 

It is interesting to see how uniform minimum aberration designs perform 
under the /3-word-length pattern. In principle, given a design, one can al- 
ways find the best design related to the /3-word-length pattern by permuting 
levels for all factors. However, the computational burden makes it infeasi- 
ble to evaluate all /3j{D) values even for three- level designs with moderate 
number of factors. Here we only consider permuting levels of regular mini- 
mum aberration designs with 27 runs and n = 4 to 10 columns and compute 
their /3-word-length patterns. To our surprise, for all cases, the permuted 
designs with best /3-word-length patterns always have the least centered 
L2-discrepancies and vice verse; that is, the uniform minimum aberration 
designs are the best designs under the /3-word-length pattern. Of course, 
there are cases where different designs have the same CD value but differ- 
ent /3-word-length pattern, and vice verse. Moreover, for n = 4 to 8, the 
/?-word-length pattern and centered L2-discrepancy give the exactly same 
ordering of the permuted designs. For n = 9 or 10, the orderings under the 
two criteria are quite consistent, though not identical. 

We end this section with a theoretical result. Notice that a regular 3"~^ 
minimum aberration design has resolution n so that Ai = ■ ■ ■ = A^-i = 0, 
which implies /3i = • • • = /3„_i = 0. The following theorem gives an interesting 
relationship between the CD value and /3„. 

Theorem 4.1. For a regular 3"~^ minimum aberration design D, 




Theorem 4.1 shows that the two criteria, centered L2-discrepancy and 
/3-word-length pattern, are exactly equivalent for regular 3"~^ minimum 
aberration designs. 

5. Conclusion. Uniform FF designs are useful for studying quantitative 
factors with multiple levels; however, the construction of such designs is 
challenging. We establish a connection between uniformity and aberration 
by showing that the average centered L2-discrepancy is a function of the 
word-length pattern. We propose to construct uniform FF designs by per- 
muting levels of existing minimum aberration designs. Using this strategy, 
we construct regular uniform minimum aberration designs with 27 runs and 
81 runs for practical use. We further evaluate the performance of the uni- 
form minimum aberration designs for polynomial models. They perform well 
under the /3-word-length pattern. 
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APPENDIX: PROOFS OF ALL THEOREMS 

For an (A^, s")-design D = (xj^), let dH{i,j) be the Hamming distance of 
rows i and j of D, that is, dH{i,j) = ^{k : Xik Xji^jk = 1, . . . , n}, where ^{S) 
is the cardinality of S. The distance distribution of D is {Bq{D), Bi{D), . . . , 
Bn{D)), where 

Bj (D) = A-^tt{(a, b) : dnia, 6) = j and a, 6 = 1, . . . , N} for j = 0, . . . , n. 

Xu and Wu (2001) showed that the (generalized) word- length pattern can 
be calculated by the MacWilliams transform of the distance distribution, 
that is, 

n 

A, {D) = J2 Bi{D)Pj {i; n, s) for j = 0,...,n, 

where Pj{x;n,s) = I]i=o(~l)*(s ~ (jl^) Krawtchouk poly- 

nomials. 

By the orthogonality of the Krawtchouk polynomials, we also have 

n 

Bj{D) = N ■ s-"^Pj{r,n,s)A,{D). 

The following existing property related to Krawtchouk polynomials was 
stated in MacWilliams and Sloane (1977). 

Lemma A.l. For nonnegative integers n,x and s with n>x, s>2 and 
0<y<l, 

71 

^ Pj{x; n, s)y^ = [l + {s- l)y]"-"(l - yf . 

To prove Theorem 2.2, we need the following lemma. 

Lemma A. 2. For an (N, s"")- design D, denote 5ij as the number of po- 
sitions where rows i and j take the same value, that is, 5ij = n — dH{i,j)- 
Then for any positive number z greater than 1, 




Proof. According to the definition of distance distribution. Lemma A.l 
and the relationship between distance distribution and word-length pattern. 



UNIFORM FRACTIONAL FACTORIAL DESICNS 



13 



we have 

N n n n 



2 + s — 1 \ v-^ / z — I 



i=0 



Proof of Theorem 2.2. Notice that for an (A^, 3^^) -design D = (xik) 
with Xjfc = 0,1, or 2, Uik and Ujk in formula (2.2) can only take values 
1/6, 1/2 and 5/6. If Uik = 1/2, 1 + ^\uik — || — ^\uik — |P takes value 1; 
otherwise, it takes value 10/9. Furthermore, if Uik = ujk = 1/6 or Uik = Ujk = 
5/6, 1 + ^\uik — ^1 + ^l^jA; ~ ^1 ~ ^\uik — Ujk\ takes value 4/3; otherwise, 
it takes value 1. Thus for any two rows of an (A^, 3")-design D, denoted 
by {xii,Xi2,...,Xin) and {xji,Xj2, . . . ,Xjn), if we define 7j(Z)) = tt{fc : Xjfc / 
1, A; = 1, . . . , n} and ^ij{D) = [J{A; : Xik = Xjk ^ l,k = 1, . . . , n}, the CD value 
of D can be determined by the distributions of its 7^ and 'jij values. That 
is, formula (2.2) can be simplified to 



(A.l) 



Vl2j 



N 



4\7»{i)) I /4\7ii(C) 



A^2 V 3 ; Af 2 ^ V 3 



Moreover, for any fixed row i of D, when all level permutations of D are 
considered, each n-tuple in GF(3)" occurs 2" times. For any element in 
the kth. column, there are three possible choices, that is, 0, 1, 2, corresponding 
to ^,1, ^ for 1 + ^\uik - || - ^\uik - IP- So 



D'eV{D) 

Similarly, 



D'eV{D) 



3/ V3 3/ V3/ V9 



For any two rows i and j of D with Hamming distance dH{i,j) = n — 6ij, 
when level permutations of corresponding columns are considered, each iden- 
tical pair, that is, {I, I), I G GF(3), occurs twice in 6ij positions where rows i 
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and j coincide, and each distinct pair occurs once in corresponding dH{i,j) 
positions where rows i and j differ. So 




Finally, the result follows from Lemma A. 2 and the fact Aq = 1. □ 



Proof of Theorem 3.3. We wih use formula (A.l) to calculate the 
CD values. First, we prove that the distributions of 'jij values for the two de- 
signs -Do a-nd Di are the same. Because Di is obtained by adding 1 (mod 3) 
to the last column of Dq, ^ij{DQ) ^ jij{Di) if and only if both last po- 
sitions of rows i and j of Dq have the same value or 1. For any two 
distinct rows of Dq with the last positions both taking value 0, denoted 
by (xii,Xi2,. . . ,Xi^n-i,0) and {xji,Xj2, ■ ■ ■ ,Xj^n~i,0), respectively, there ex- 
ists a unique pair of rows of Di, (xji, . • . , x,; - 1, Xj^z+i, . . . , Xi,„_i, 2) 
and {xji, . . . , Xj^i-i,Xji — 1, Xj^i^i, . . . , Xj_„,_i, 2), where I is the first position 
such that Xii ^ Xji. These two pairs have the same jij value. Similarly, for 
any two distinct rows of Dq with the last positions both taking value 1, 
{xii,Xi2, ■ ■ ■ ,Xi^n-i, 1) and {xji,Xj2, ■ ■ ■ ,Xj^n-i, 1), there exists a unique pair 
of rows of Di, {xii,...,Xi^i-i,Xii + l,Xi^i+i,...,Xi^n-iA) and (xji, . . . ,Xj^i-i, 
Xji + l,Xj^i+i, . . . ,Xj^n-i, l)i with the same 'jij value, where I is the first po- 
sition such that Xii ^ xji. It is easy to see that the above correspondence 
between two pairs of rows in Dq and Di is actually one-to-one (bijective). 
This completes our claim on the distributions of jij values. 

Now we consider the distributions of 7j values of Dq and Di. For a de- 
sign D, denote r]j{D) = tJ{i : ^i{D) = j,i = 1, . . . , N},j = 0, 1, . . . , n, as the 
distribution of 7j values of D. Obviously, r/o(-Do) = 1 as Dq contains the all- 
one row, and r/o(-Di) = 0. Moreover, for any j = 0, 1, . . . , n, the total number 
of rows in GF(3)" with 7^ = j is (p2J'; therefore, Vj{Do) + 2r]j{Di) = (^2^'. 
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For convenience, if a vector with length j only contains or 2, it will be called 
a (0, 2)-' -vector. Then ?/j(L'o)/(") is the number of possible (0, 2)-' -vectors 

with sum j (mod 3) and r]j{Di)/ is the number of possible (0, 2)-^ -vectors 

with sum J + 1 (mods). Notice that a (0, 2)-' -vector with sum j — 1 (mod 3) 
can be obtained by conducting a "mirror image" operation to a (0, 2)-^ -vector 
with sum j + 1 (mods). Thus rjj{Di) / also represents the number of pos- 
sible (0, 2)-' -vectors with sum j — 1 (mod 3). Each (0, 2)-^ -vector with sum 
j (mods) can be formed by adding 2 or to a (0, 2)-'~^-vector with sum 
(j - 1) - 1 or (j - 1) + 1 (mods). So we have r/,(Z)o)/g) = 2r^j.i{D^) / {.\) . 
Combining this with ?7j(-Do) + "^VjiDi) = (")2J' and r]o{Di) = 

miDi) = 0^^^ and v,{Do) = {^)?!±^. Thus rj,{Do 
(p(-l)J'. Using formula (A.l) and N = S"-\ we have 



0, we obtain 

) - rum = 



4>(Do)-<P{Di) = —. 



1 

j=0 



N ^ 



(-1) 



1 

iV2 



2iV — 



2iV 



Ar2 

From Theorem 2.2, we also have 

0(A) + 20(i^i 
Then we have 

0(^0) 

and 

4>{D{) -- 



1 
9 

(-ir 

33n-l 



IS 
12 

29 
27 



+ 2 



+ 2 



+ 



2(-l) 

33n 



+ 



(-1) 



n+1 



33n 



□ 



Proof of Theorem 4.1. For a regular S*^"^ minimum aberration de- 
sign D = (xik) with resolution n, its f5n{D) is determined by the product of 
linear polynomials as follows: 

2 



(A.2) 



Pn{D) = N^ 



N 



^Pl(Xii) X • • • X pi{Xin) 



i=l 



where = S" ^ and pi{x) = ^^/3/2{x — 1). Because ^1(2;) = when x = 1, we 
only need to consider rows with or 2 only, that is, (0, 2)"-vectors. Notice 
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that Dq is an (n — l)-dim linear space or a coset over GF(3) containing 
the all-one vector, thus run (2 — zi, . . . , 2 — z„) occurs in Dq if and only if 
{zi,. . . , Zn) occurs in Dq. So for any odd n, /3„(Z)o) = according to (A. 2). 
To calculate f3n{Di) for odd n, we will establish a recursive formula. For 
this purpose, we use to denote a design Di with n columns; that is, the 
sum of each row of the design is congruent to n + i modulo 3 for i = 0, 1, 2. 
Then, up to row permutations, we can express as follows: 





1 





D^- 


1 


1 


^0 


1 


2 



Let (^(L'" ) be the difference between the number of (0, 2)"' ^-vectors in 
D^-^ with even number of zeros and the number of those with odd number 
of zeros for i = 0, 1,2. Then, according to (A. 2), we have 

(A.4) /3„_i(Z)ri)=3^2(n-2)(3/2)n-i|5p--i)|2 for 1 = 0,1,2. 

Furthermore, when n - 1 is even, S{Dq~^) + + S{D'2~^) = and 

6{D^-^) = -26{D'^-^) = -25{D^-^). Then, according to (A.2) and (A.3), 
for odd n, we have 

/3„(D5^) = 3"2("-i)(3/2)"| - S{D1^~^) + 5{D^-^)\^ 

(A.5) 

= 3-2("-i)(3/2)"| -3<5(L'5i^-^)|2. 

Combining (A.4) and (A.5), we obtain /3„(£'f) = (3/2)/3„_i (Z)^~^). In the 
same vein, for even n, we can establish Prr{D'l) = {l/Q)Pn-i{D'^~^) and 
Pn{D^) = (2/3)/3„„i(Dr')- So for odd n, /3„(D]^) = (3/2)/3„„i(Dr') = 
(1/4) X I3n-2{D1~'^). It is easy to verify that (i'iiDl) = 3/8; thus for odd 
n, /3n(£>f) = (3/8)(l/4)("-3)/2 ^ 3/2". For even n, we obtain /3„(L'f) = 
(l/6)(3/2"-i) = 1/2" and Pn{Dl) = (2/3)(3/2"-i) = l/2"-2. Then the re- 
sult follows from Theorem 3.3. □ 
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